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1 

HARDWARE SIMULATION SYSTEMS AND 
METHODS FOR VISION INSPECTION SYSTEMS 

BACKGROUND OF THE EWENTION 

1. Field of Invention 

This invention is directed to methods and systems that simulate images 
produced by a vision system. More particularly, this invention is directed to methods 
and systems that generate a synthetic image that accurately approximates an image 
produced by an automated vision inspection system. 

2. Description of Related Art 

A wide variety of non-contact computer-vision-based systems exist that 
recognize or measure key features of parts or materials in a manufacturing 
environment. Many of these systems have a "training" or "programming" mode. In 
the programming mode, the system receives instructions regarding how to recognize 
or measure a part. This programming mode results in a set of instructions that are 
automatically repeated by the system. These instructions may be organized as a 
program in a general purpose scripting language or as a macro sequence. Stored 
program instruction sequences in either scripting or macro languages are known as 
part programs. The sequence of learning or training a part program is known as part 
programming. 

SUMMARY OF THE INVENTION 
Off-line programming software tools are popular for traditional, non-image- 
based coordinate measuring machines and robots. Off-line programming tools assist a 
programmer in selecting machine instructions to include in a program for the non- 
image-based coordinate measuring machines and robots. However, these off-line 
programming software tools do not account for problems experienced when forming 
optical images through physical lens systems because such concerns are not present in 
traditional, non-image-based coordinate measurement machines or robots. Therefore, 
these known off-line programming software tools are inadequate for any machine that 
includes a machine vision system and totally unsuitable for modem image-based 
inspection and/or motion systems. 
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The systems and methods of the invention use 3D graphical models of 
workpieces to simulate the images produced by the physical hardware of a vision 
inspection system. An exemplary embodiment of the system and method of this 
invention provides these synthetic images at a speed which approximates the real-time 
generation of images in a real vision inspection system. The simulation systems and 
methods of this invention produce synthetic video images that are comparable to the 
images that are captured by a camera looking through a lens at a workpiece in a vision 
inspection system. 

The simulation systems and methods of this invention may be integrated with 
a user interface from machines which include a machine vision system, and especially 
with a user interface from a vision inspection system, to provide an off-line 
programming environment. The term "off-line programming" describes the creation 
of a part program without interfering with the ongoing operation of a physical vision 
inspection system. 

The methods and systems of the invention separately provide vision 
simulation systems that allow vision system designers to develop software-only 
versions of vision inspection systems. Such software-only implementations will 
present the same user interface to operators as would be presented by a corresponding 
physical vision inspection station. Hardware emulation modules in the systems and 
methods of this invention simulate physical components of the visual inspection 
stations, such as cameras, lighting, lenses and motion control platforms. The 
simulation systems and methods of this invention generate synthetic images based on 
state models of the vision systems and computer-aided-design models of workpieces 
to be measured. The computer-aided-design models of workpieces may be provided 
by conventional commercial CAD packages, such as pro/ENGINEER from 
Parametric Technology Corporation, Waltham, MA 02453, and may coincide with the 
CAD data files which govern manufacturing of actual workpieces which would 
eventually be placed under the actual vision inspection station. 

The synthetic images generated by the systems and methods of this invention 
may be used in place of the video captured by a camera in a hardware-based vision 
system. The systems and methods of this invention allow designers to readily develop 
an off-line version of an inspection system by replacing hardware-based software 
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subsystems with subsystems that communicate with virtual components of a vision 
simulation engine. Operators are able to modify parameters in the virtual inspection 
system and immediately see the results as a change in the synthesized image. Because 
the inspection system simulation systems and methods of this invention are usable 
with existing vision inspection system user interfaces, a user may gain familiarity with 
the user interface prior to interacting with an actual physical vision inspection system. 

The inspection system simulation systems and methods of this invention 
reduce system downtime due to creating new inspection part programs. The systems 
and methods of this invention are also able to improve operator training and to 
provide improved tools for off-site sales and marketing of vision inspection systems. 

These and other features and advantages of this invention are described in or 
are apparent from the following detailed description of the exemplary embodiments. 
BRIEF DESCRIPTJON OF THE DRAWINGS 
The preferred embodiments of this invention will be described in detail, with 
reference to the following figures, wherein: 

Fig. 1 is a block diagram of one exemplary embodiment of a hardware-based 
vision inspection system; 

Fig. 2 is a block diagram of the exemplary embodiment of the vision 
inspection system using one exemplary embodiment of an inspection system 
simulation system in accordance with this invention; 

Fig. 3 is a block diagram showing in greater detail one exemplary embodiment 
of a vision simulation engine in accordance with this invention; and 

Figs. 4A and 4B are a flowchart outhning one exemplary embodiment of a 
method for rendering synthesized images in accordance with this invention. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
Fig. 1 is a block diagram of one exemplary embodiment of a physical vision 
inspection system 10. The vision inspection system 10 includes a vision inspection 
control system 12. The vision inspection control system 12 includes a user interface 
subsystem 14, a data processing subsystem 16 and a hardware interface 20. The 
hardware interface 20 includes a hght control subsystem 22, a framegrabber 
subsystem 24, a lens control subsystem 26 and a motion control subsystem 28. The 
hardware interface 20 communicates with the vision system hardware components 30. 
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In particular, the vision system hardware components 30 includes lighting hardware 
32, framegrabber 34, lens hardware 36 and motion control hardware 38. The 
fi-amegrabber 34 may include an internal or external framegrabber mechanism to 
produce still or real-time digital representations of a scene viewed by a monochrome 
or color camera. The camera and the framegrabber 34 combination described herein 
is intended to include both analog and digital camera configurations. For example, a 
digital camera may include an integral framegrabber. 

Each of the physical hardware systems 32-38 of the vision system hardware 
components 30 represent one or more physical components of a typical machine 
vision inspection system. The systems and methods of this invention use graphical 
and physical modeling techniques to replace all of these components with a virtual 
model of the vision system hardware components 30. 

One example of a commercially available vision mspection system which 
corresponds to the vision inspection system of Fig. 1, is the Quick Vision series of 
vision inspection machines available from Mitutoyo MTI Corporation Aurora, IL 
One example of a commercially available vision inspection control system including a 
user interface subsystem which corresponds to vision inspection control system 12 
and user interface subsystem 14 of Fig. 1, is the QVPak operating software for the 
Quick Vision series of vision inspection machines available from Mitutoyo MTI 
Corporation Aurora, IL 

Fig. 2 shows one exemplary embodiment of a vision simulation system 100 
according to this invention, comprismg a vision inspection control system 110 and 
one exemplary embodiment of a vision system hardware components simulation 
system 140 according to this invention. The vision inspection control system 1 10 is 
identical to the vision inspection confrol system 12 of Fig. 1 and includes a user 
interface subsystem 1 14, a data processing subsystem 1 16 and a hardware interface 
120. The hardware interface 120 includes a Ught confrol subsystem 122, a 
framegrabber subsystem 124, a lens confrol subsystem 126 and a motion confrol 
subsystem 128. 

The vision system hardware components simulation system 140 is preferably 
implemented on a programmed general purpose computer. However, the vision 
system hardware components simulation system 140 can also be unplemented on a 
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special piupose computer, a programmed microprocessor or microcontroller and 
peripheral integrated circuit elements, an ASIC or other integrated circuit, a digital 
signal processor, a hardwired electronic or logic circuit such as a discrete element 
circuit, a programmable logic device such as a PLD, PLA, FPGA or PAL, or the like. 
5 In general, any device, capable of implementing a finite state machine that is in turn 
capable of implementing the flowcharts shown in Figs. 4A and 4B, can be used to 
implement the vision system hardware components simulation system 140. 

The hardware interface 120 communicates with the vision system hardware 
components simulation system 140 over links 142 and 144. The vision system 

10 hardware components simulation system 140 includes a vision inspection system 
simulation processing subsystem 146 which communicates with a configuration 
subsystem 148, and an external view 150. 

It should be appreciated that, if the vision system hardware components 
simulation system 140 is implemented in hardware or remotely from the vision 

1 5 inspection control system 110, the links 142 and 144 can be any now known or later 
developed device or system for connecting the vision inspection control system 1 10 to 
the vision system hardware components simulation system 140, including a direct 
cable connection, a connection over a wide area network or a local area network, a 
connection over an intranet, a connection over the Internet, or a connection over any 

20 other distributed processing network or system. In general, the links 142 and 144 can 
be any known or later developed connection system or structure usable to connect the 
vision inspection control system 1 10 to the vision system hardware components 
simulation system 140. 

If the vision system hardware components simulation system 140 is 

25 implemented locally to the vision inspection control system 110, such as by a 

software application program, the links 142 and 144 are software structures that route 
data and control signals between the vision inspection control system 110 and the 
vision system hardware components simulation system 140. The vision system 
hardware components simulation system 140 receives control data over the link 142 

30 from the vision inspection system simulation system 1 10 and sends synthetic image 
data over the link 144 to the vision inspection control system 110. 
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The configuration subsystem 148 stores models of a virtual world and includes 
a systems lighting model, a motion control model, a workpiece model, and lens and 
camera configuration data that are used by the processing subsystem 146 to produce 
still and/or real-time synthetic images. 

As shown in Fig. 2, the vision system hardware components simulation system 
140 is integrated with the vision inspection control system 110, which is intended to 
drive the physical vision system hardware components 30. The vision system 
hardware components simulation system 140 is a hardware- or software-based 
emulation system that replaces the physical cameras, lenses, lights, stages, etc. of the 
physical vision system hardware components 30 shown in Fig. 1, 

The vision system hardware components simulation system 140 is capable of 
producing images of a simulated vision inspection target at differing heights relative 
to a virtual optical system and camera. These synthetic images, which may include 
out-of- focus images and lighting effects, facilitate rapid and intuitive off-line 
programming. 

The vision system hardware components simulation system 140 can also 
produce a three-dimensional external view 150 of the entire simulated vision 
inspection system. The external view approximates what is seen by the user when 
physically viewing a physical vision inspection system. Such an external view 
provides many important spatial cues to a system operator to further facilitate rapid 
and intuitive off-line programming. 

A user of the systems and methods of this invention can import and fix 
computer-aided design (CAD) models of workpieces onto a virtual stage of the vision 
system hardware components simulation system 140 by importing and storing CAD 
models in the configm-ation subsystem 148. Real-time, synthetic digital images of the 
stage and the workpiece are then created and provided to the vision inspection control 
system 1 10 by the vision system hardware components simulation system 140. Users 
may then inspect the simulated workpieces on the virtual vision inspection machine 
simulated by the vision system hardware components simulation system 140 to select 
instructions for part programs that will run on the physical vision inspection system 
that is being simulated by the vision system hardware components simulation system 
140. 
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The processing subsystem 146 creates synthetic images by taking at least one 
of the following factors into account: camera position and view; light source 
positioning; orientation of the workpiece relative to the stage; current position and 
orientation of the stage relative to the camera; lens subsystem parameters, such as 
5 focal length; the geometry of the modeled lens system; the optical effects produced by 
the lens and lighting systems; the optical properties of the workpiece; and the physical 
properties of the workpiece. 

Fig. 3 shows another exemplary embodiment of the vision system hardware 
components simulation system 140 of the vision simulation system 100 in accordance 

10 with the invention. As shown in Fig. 3, in this exemplary embodiment, the vision 
system hardware components simulation system 140 includes an input/output 
interface 200 and a rendering engine 202. The interface 200 includes subsystems that 
store the position of the virtual stage, the parameters for the virtual lens system and 
the parameters for the lighting system. The parameters of the virtual lighting system 

15 include the magnitude, the color, the orientation and the type of each virtual light 

source in the system. The parameters of the virtual lens system include magnification, 
field of view, focal length and depth of field of the simulated lens system. 

The vision system hardware components simulation system 140 also includes 
a lighting model 206 which models Ught emanating fi^om each virtual lighting source. 

20 The lighting model 206 describes the light fi-om each virtual lighting source and 
includes information regarding position, orientation, magnitude, color and type of 
light firom each Ught source. 

The vision system hardware components simulation system 140 also includes 
a virtual world model 208, a static environment model 210, a virtual stage model 212 

25 and a component model 214. The models 208-214 record and update the geometrical 
and physical model descriptions of a virtual stage and virtual workpieces. Each 
component is described in the corresponding model 208-218 in a scene hierarchy 
consistent with current graphical surface modeling techniques. Each model is a set of 
polygons connected at a collection of common nodes. Each node contains 

30 information such as position, color, material information, and texture coordinates. 

Each object may include one or more texture maps to be applied to the surface faces. 
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The virtual world model 208 stores a complete current 3D model of the virtual 
stage table, the virtual movable stage components and all of the virtual workpieces on 
the virtual stage. This virtual world model 208 is constructed from a hierarchy of 
components that include the static environment model 210, the virtual stage model 
5 212 and the component model 214, including the position and orientation of the 
workpiece on the stage. When the virtual stage moves relative to the virtual stage 
table, the workpieces on the stage translate in a global coordinate system accordingly. 

The vision system hardware components simulation system 140 also includes 
a lens system model 216 which stores virtual lens system data, such as field of view 

10 and perspective. The lens system model 216 transmits lens system data to the 
rendering engine 202. 

The foregoing description assumes a typical case for many machine vision 
systems, where the camera is fixed in a global coordinate system, and the workpieces 
are moved relative to the camera by means of a moving stage component, for example 

15 an X-Y table, a conveyor belt, or the like. In other cases, where the camera and 

optical system are mounted in a gantry configuration, or on the end of a robotic arm, 
the camera and optical system move relative to the global coordinate system, and the 
workpiece remains fixed relative to the global coordinate system. In the later case, the 
lighting model 206 should include the lighting position and orientation relative to the 

20 workpiece and the lens system, and the lens system model 216 should include the lens 
system position and orientation relative to the workpiece(s), stage, static model and 
world model. In the later case, the stage model 212 has no moving features, and may 
be included in the static model. In any case, the crucial data for image simulation is 
the relative position and orientation of the optical system, the workpiece(s) and the 

25 lighting system, and one skilled in the art can allocate relative position data for these 
elements to the appropriate models according to any of the well-established methods 
for relating objects in a set of local and global coordinate systems. 

The vision system hardware components simulation system 140 also includes 
a memory 218 which stores the two-dimensional image. 

30 The vision system hardware components simulation system 140 also includes 

a rendering engine 202. Examples of such a rendering engine is OpenGL or 
Direct3D. OpenGL is an open standard for 3D graphical rendering which is described 
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in OpenGL Reference Manual, OpenGL Architecture Review Board, Addison- Wesley 
Developers Press, Reading, MA, 1996. DirectSD is a component of the DirectX 
system of tools distributed by Microsoft Corporation in conjunction with their 
Windows™ operating system. The rendering engine 202 accepts as input the 3D 
5 polygonal model stored in the virtual world model 208, the lens model 216 and the 
lighting model 206. The rendering engine 202 may be any system which produces a 
two-dimensional image and a depth map given a three-dimensional model, using 
Gouraud shading, raytracing, etc. The rendering engine 202 receives the 3D 
polygonal model and lighting data from the lighting model 206 and the virtual world 

10 model 208, respectively. 

The rendering engine 202 creates two-dimensional image data as viewed 
through an ideal pinhole lens system. The 2D image data includes a two-dimensional 
mapping which stores the distance of each pixel in the image map from the virtual 
camera. The rendering engine 202 also generates the three-dimensional external view 

15 150 of the virtual world (shown in Fig. 2). As described above, the three-dimensional 
external view 1 50 emulates a view of the system as would be seen by an operator of 
the vision inspection system. 

The two-dimensional camera image data does not simulate real world camera 
information. The two-dimensional camera image data has an infinite depth of focus 

20 as if it were created using a perfect pinhole camera. This does not acciirately simulate 
the view of real machine vision inspection systems, which often have very small 
depths of field. Therefore, the vision system hardware components simulation system 
140 also includes a lens effects processing engine 204. The lens effect processing 
engine 204 receives the two-dimensional camera image data including the depth per 

25 pixel data from the rendering engine 202. The lens effects processing engine 204 

modifies the camera image in accordance with the virtual lens parameters. The lens 
effects processing engine 204 outputs a two-dimensional image. This two- 
dimensional image takes into account the virtual optical geometry of the system. One 
example of a lens effects processing engine is described in A Lens and Aperture 

30 Camera Model for Svnthetic Image Generation, Computer Graphics, vol. 15, no. 3, 
pp. 297-305, August 1981. 
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It should be understood that the lens effects engine 204 and the rendering 
engine 202 may form portions of a single processor or may be separate processors. 
Moreover, the rendering engine 202 and the lens effects engine 204 can be combined 
into a single rendering and lens effects engine. Such a combined rendering and lens 
5 effects engine could be used, for example, with ray tracing rendering to follow each 
ray through the optical system. 

It should be imderstood that each of the models shown in Fig. 3 can be 
implemented as portions of a suitably programmed general purpose computer. 
Alternatively, each of the models shown in Fig. 3 can be implemented as physically 

10 distinct hardware circuits within an ASIC, or using FPGA, a PDL, a PLA or a PAL, or 
using discrete logic elements or discrete circuit elements. The particular form each of 
the models shown in Fig. 3 will take is a design choice and will be obvious and 
predicable to those skilled in the art. 

Figs. 4A and 4B are a flowchart outlining one exemplary embodiment of a 

1 5 method for rendering a vision simulation of a vision inspection system in accordance 
with this invention. As shown in Fig. 4A, the control routine starts at step S 100 and 
continues to step S102. In step SI 02, components of the virtual world, such as a 
table, camera, lighting, etc. are initiahzed. Then, in step SI 04, the models of the 
workpieces are added to the virtual world. Next, in step SI 06, a stage position is 

20 determined. Control then continues to step SI 08. 

In step SI 08, the positions of the virtual stage and of all workpieces on the 
virtual stage are updated. Next, in step SI 10, the virtual world model is updated 
based on other system parameters, such as lighting, lenses, etc. Then, in step S112, 
the virtual world is rendered to form a two-dimensional camera image and a 

25 corresponding map of pixel depth data. Control then continues to step S114, which is 
shown in Fig. 4B. Then, in step SI 14, a determination is made whether lens effects 
are required. If lens effects are required, control continues to step SI 16. 
Alternatively, if lens effects are not required, control jumps directly to step SI 18. In 
step SI 16, virtual lens effects are applied to the simulated image. Next, in step SIX 8, 

30 the virtual camera view is provided to a vision inspection control system. Control 
then continues to step SI 20. 
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In step SI 20, a determination is made whether a virtual external view is 
required. If a virtual external view is required, control continues to step SI 22. If a 
virtual external view is not required, control jumps directly to step SI 24. In step 
SI 22, the virtual external view of the system is rendered. Then, in step 8124, a 
5 determination is made whether the vision simulation engine should be halted. If the 
vision simulation engine is to be halted, control continues to step S126. If the vision 
simulation system is not to be halted, control jumps back to step S106. In step S126, 
the vision simulation engine is stopped. 

It should be appreciated that steps SI 12-Sl 16 can be combined into a single 
10 step that both renders the image and simultaneously adds any lens effects to the 

image. For example, in a ray tracing system, as each ray is used to render a portion of 
the image, the path of that ray is followed through the optical system to account for 
any lens effects. 

It should be further appreciated that the flowchart outlined in Figs. 4A and 4B 

15 is one exemplary embodiment of a more-general method for rendering a simulated 
image from a machine vision system. The machine vision system can be a vision 
inspection system or a vision system attached to some other machine, such as a robot. 
This method for rendering the simulated image includes generating a simulated image 
of a virtual world based upon a first model that characterizes or represents at least one 

20 object in the virtual world and a second model that characterizes or represents an 

optical system, and providing the simulated image to a machine vision control system. 
The machine vision control system can be an inspection program generation system, 
such as a system for generating a part program for the vision inspection system 
described above, or a motion command generation system, such as a system for 

25 generating motion commands for a robot having a machine vision system. 

Operators are able to modify parameters in the machine vision system and 
immediately see the results as a change in the synthesized or simulated image. 
Because the machine vision simulation systems and methods of this invention are 
usable with existing machine vision system user interfaces, such as vision inspection 

30 system user interfaces, a user may gain familiarity with the machine vision user 
interface prior to interacting with an actual physical vision inspection system. 
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While this invention has been described with the specific embodiments 
outlined above, many alternatives, modifications and variations are apparent to those 
skilled in the art. Accordingly, the preferred embodiments described above are 
illustrative and not limiting. Various changes may be made without departing fi-om 
5 the spirit and scope of the invention. 
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WHAT IS ^AIMED IS : 

ZA vision system hardware component simulation system for machine 
nprising: 

a first model representing at least one object; 
5 a second model representing an optical system; and 

a processor that generates an image of a virtual world containing the at 
least one object based upon the first model and the second model. 

2. The vision system hardware component simulation system of claim 1, 
wherein: 

10 at least one of the first and second models includes information which 

characterizes the relative orientation and position of the corresponding at least one 
object and the optical system; 

the image of the virtual world comprising an image of the at least one 
object as seen through the optical system. 

15 3 . The vision system hardware component simulation system of claim 1 , 

further comprising at least one additional model representing at least one of a stage, a 
workpiece fixture and a lighting system, wherein the processor further generates the 
image of the virtual world based on the at least one additional model. 

4. The vision system hardware component simulation system of claim 3, 
20 wherein the at least one additional model further represents a stage table. 

5. The vision system hardware component simulation system of claim 3, 
wherein the at least one additional model is a hghting system model that represents at 
least one of a magnitude, a color, a type and an orientation of at least one lighting 
source. 

25 6. The vision system hardware component simulation system of claim 3, 

wherein the first model comprises a representation of at least one of a position and an 
orientation of the at least one object relative to the stage. 

7. The vision system hardware component simulation system of claim 1 , 
wherein the second model comprises: 
30 a lens system model; and 

a lighting model. 
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8. The vision system hardware component simulation system of claim 1, 
wherein the first model comprises at least one of: 

a world model; 
a static model; 
5 a stage model; and 

a component model. 

9. The vision system hardware component simulation system of claim 8, 
wherein the world model is at least partially constructed fi-om at least one of the static 
model, the stage model and the component model. 

10 10. The vision system hardware component simulation system of claim 1 , 

wherein the processor comprises: 
a rendering engine; and 
a lens effects engine. 

1 1 . The vision system hardware component simulation system of claim 1 , 
1 5 wherein the processor comprises a rendering and lens effect engine. 

12. The vision system hardware component simulation system of claim 1 , 
wherein the second model represents an optical system having an infinite depth of 
field. 

1 3 . The vision system hardware component simulation system of claim 1 , 
20 fiirther comprising a control instruction generation system. 

1 4. The vision system hardware component simulation system of claim 13, 
wherein the control instruction generation system comprises an inspection program 
generation system. 

1 5. The vision system hardware component simulation system of claim 1 3, 
25 wherein the control instruction generation system comprises a motion command 

generation system. 

1 6. The vision system hardware component simulation system of claim 1 , 
wherein the second model characterizes an image capture system and a lens system. 

1 7. The vision system hardware component simulation system of claim 1 6, 
30 wherein the second model characterizes at least one of an aperture, a focal length, an 

image magnification, and an optical system geometry of the lens system. 
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1 8 . The vision system hardware component simulation system of claim 1 6, 
wherein the second model characterizes at least one of an imaging system pixel size 
and an imaging system pixel spacing of an image capture system. 

1 9 . The vision system hardware component simulation system of claim 1 , 
further comprising a user interface that presents the image. 

20 . The vision system hardware component simulation system of claim 1 , 
further comprising a user interface includes means for modifying at least one of the 
first and second models. 

2 1 . The vision system hardware component simulation system of claim 1 , 
further comprising a user interface for a machine vision inspection system to simulate, 
the user interface simulating at least one operation of the machine vision inspection 
system independent of at least one component of the machine vision inspection 
system. 



one machine vision hardware component, comprising: 

generating a simulated image of a virtual world containing at least one object 
based upon a first model that characterizes the at least one object and a second model 
that characterizes an optical system; and 

providing the simulated image to a machine vision control system. 

23. The method of claim 22, wherein generating the simulated image based 
on the first and second models comprises: 

processing position data characterizing a relative position and orientation of 
the at least one object and the optical system; 
processing component data; and 
processing optical system parameters. 

24. The method of claim 23, wherein generating the simulated image based 
on the first and second models further comprises processing Hghting system 
parameters, the lighting system parameters including at least one of a position and an 
orientation relative to the at least one object, a magnitude, a color and a type of at 
least one hghting source. 

25 . The method of claim 22, wherein: 




A method for simulating images based on the characteristics of at least 



the first model comprises at least one of a component model, a stage 
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model and a static model; and 

generating the simulated image further comprises generating the 
simulated image based on at least one of the component model, the stage model and 
the static model. 

5 26. The method of claim 25, wherein the stage model represents at least 

one of a stage table and a movable stage component. 

27. The method of claim 26, wherein the component model includes a 
representation of at least one of a position and an orientation of the at least one object 
on the movable stage component. 
10 28. The method of claim 22, wherein the second model characterizes an 

optical system with an infinite depth of field. 

29. The method of claim 22, fiirther comprising generating at least one 
inspection program instruction based on the simulated image. 

30. The method of claim 22, wherein the at least one inspection program 
1 5 instruction is based upon a user input. 

3 1 . The method of claim 22, fiirther comprising generating at least one 
control instruction based on the simulated image. 

32. The method of claim 3 1 , wherein generating the at least one control 
instruction based on the simulated image comprises generating an inspection program. 

20 33. The method of claim 3 1 , wherein generating the at least one control 

instruction based on the simulated image comprises generating a motion command. 
34. The method of claim 22, further comprising: 

altering at least one of the first and second models based on at least one 
user input; and 

25 modifying the simulated image based on the altered one of the first and 

second models. 

3 5 . The method of claim 34, further comprising repeating the altering and 
modifying steps. 

36. The method of claim 35, wherein the repeating continues until the 
30 simulated image represents a machine vision system state desired by the user. 
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A method for facilitating the generation of at least one machine control 
instniction for a machine having a machine vision system independently of at least 
one element of the machine vision system, the method comprising: 

rendering a synthetic image of at least one object as viewed through the 
machine vision system based on a representation of at least one component of the 
machine vision system; and 

selecting a machine control instruction based at least in part on the 
synthetic image. 

38. The method of claim 37, wherein rendering the synthetic image 
comprises updating in real-time a view of the at least one object through the 
simulation of the machine vision system in response to the user altering the 
representation of the at least one component of the machine vision system. 

39. The method of claim 37, wherein rendering the synthetic image is 
based on a depth of focus represented in the representation of the at least one 
component of the machine vision system. 

40. The method of claim 37, fiirther comprising: 
presenting the synthetic image to a user; and 

receiving a user input, wherein selecting the machine control instruction 
is in response to the user input. 

A method for generating a synthetic image independently of at least 
one element of a machine vision system, the synthetic image simulating an image 
from the machine vision system, the method comprising: 

initiaUzing a scene of the synthetic image of at least one object as 
viewed through the machine vision system; 

adding a workpiece model of at least one workpiece to the scene, the at 
least one workpiece positioned on a stage of the scene; 

obtaining at least one of a position and an orientation of the stage 
relative to an optical system of the machine vision system; and 

rendering the scene based on at least one of the characteristics of the 
optical system and the obtained relative position and orientation of the optical system 
to generate the synthetic image. 

42. The method of claim 41, further comprising: 
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determining if any lens effects are to be applied to the rendered image; 

and 

if any lens effects are to be applied, applying the lens effects to the 
rendered image. 

5 43 . The method of claim 4 1 , further comprising: 

determining if an external view is to be rendered based on the rendered 

scene; and 

if the external view is to be rendered, rendering the external view. 
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ABSTRACT OF THE DISCLOSURE 
The systems and methods of this invention provide simulated images to vision 
inspection systems. The simulated images emulate the vision of a vision inspection 
system. Graphical models of objects in a virtual world and lens effects models are 
5 used to provide the simulated images. 
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